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© Clock apparatus for a compressed video signal. 



© Apparatus for developing synchronization of an 
intermediate layer of signal such as the transport or 
multiplex layer of a multi-layered compressed video 
signal, includes at the encoding end of the system a 
modulo K counter (23) which is clocked responsive 
to a system clock (22), and the count valued is 
embedded (13) in the signal at the transport layer 
according to a predetermined schedule. At the re- 
ceiving end of the system a similar counter is re- 



sponsive to a controlled receiver clock signal (26) 
and the count value of this counter is sampled (18) 
at the arrival of the count values embedded in the 
transport layer. The differences of successive sam- 
pled count values of the receiver counter are com- 
pared with the differences of corresponding succes- 
sive values of the embedded count values in the 
transport layer to provide a signal to control (27) the 
receiver clock signal. 
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1 EP 0 

This invention relates to a method and appara- 
tus for providing a clock signal at a signal de- 
compression apparatus, which clock signal is sub- 
stantially frequency locked to a clock signal at a 
encoding apparatus. 

Compressed video signal generation and trans- 
mission systems may operate on several levels of 
synchronization or perhaps more properly called 
asynchronization. For example the actual compres- 
sion apparatus will be synchronized, at least in part 
to the vertical frame rate of the source video signal, 
and it may also be synchronized to the color sub- 
carrier. Once the video signal is compressed and 
formed into a particular signal protocol, such as 
MPEG 1 , it may be further processed into transport 
packets for transmission. The transport packets 
may be time division multiplexed with packets from 
other video or data sources. The packetizing and 
multiplexing may or may not be done in a mutually 
synchronous fashion, which may or may not be 
synchronous with the compression operation. The 
transport packets (whether multiplexed or not) may 
thereafter be supplied to a modem for transmission 
of the data. The modem may or may not operate 
synchronously with the prior mentioned systems. 

At the receiver of a fully multiplexed transmit- 
ted compressed signal, it is usually necessary that 
the various subsystems operate synchronously with 
their inverse function counterpart elements at the 
encoding end of the system. Synchronous opera- 
tion in this case, in general, may mean that the 
respective subsystems operate extremely close to 
the same frequencies as their counterpart sub- 
systems. For example, the decompressor should 
provide video signal at the same frame rate as 
provided by the video signal source at the com- 
pressor, and synchronized with associated audio. 
Synchronization of the video/audio decompression 
portion of the system may be accomplished by 
inserting, at the encoder, presentation time stamps 
within the compressed video/audio signals, that in- 
dicate the relative times of production/reproduction 
of respective segments of signal. Such presenta- 
tion time references, PTR's, may be used to com- 
pare the timing of associated audio and video 
signals for synchronization purposes and for proper 
sequencing and continuity. 

The receiver modem must of course operate at 
the precise frequency as the transmitting modem. 
Receiver modems typically include phase locked 
loops responsive to the transmitted carrier frequen- 
cies for generating synchronous clock signals. 

Synchronization of the multiplexing and or 
transport packetizing apparatus tends to be some- 
what more complicated for two reasons. The first is 
that multiplexed data may be arriving sporadically. 
The second is that rate buffering is usually em- 
ployed between the modem and the decompres- 
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sor, and provision must be made to insure that the 
rate buffer neither overflows nor underflows with 
the constraint that the buffer be kept as small as 
practical to minimize manufacturing cost. 

s The present invention is apparatus for develop- 

ing synchronization of an intermediate layer of sig- 
nal such as the transport or multiplex layer of a 
multi-layered compressed video signal. At the en- 
coding end of the system a modulo K counter is 

10 clocked responsive to a system clock, and the 
count valued is embedded in the signal at the 
transport layer according to a predetermined 
schedule. At the receiving end of the system a 
similar counter is responsive to a controlled re- 

15 ceiver clock signal and the count value of this 
counter is sampled at the arrival of the count 
values embedded in the transport layer. The differ- 
ences of successive sampled count values of the 
receiver counter are compared with the differences 

20 of corresponding successive values of the embed- 
ded count values in the transport layer to provide a 
signal to control the receiver clock signal. 

BRIEF DESCRIPTION OF THE DRAWINGS 

25 

FIGURE 1 is a block diagram of a compressed 
video encoding/decoding system incorporating 
clock recovery apparatus embodying the present 
invention. 

30 FIGURE 2 is a block diagram of signal mul- 

tiplexing apparatus useful in representing the de- 
velopment of multiplexed data from different sour- 
ces. 

FIGURES 3 and 5 are block diagrams of alter- 
35 native embodiments of clock recovery apparatus 
for use with transmitted compressed video data. 

FIGURE 4 is a block diagram of signal mul- 
tiplexing apparatus including a system for aug- 
menting timing references included within the mul- 
40 tiplexed signal. 

FIGURES 6 and 7 are pictorial diagrams of a 
transport block and an auxiliary signal transport 
block. 

FIGURE 8 is a flow chart of the operation of 

45 the transport processor of FIGURE 2. 

FIGURE 1 illustrates a typical system in which 
the invention may be practiced, which system is a 
compressed digital video signal transmission ar- 
rangement. In this system, video signal from a 

so source 10 is applied to a compression element 11 
which may include a motion compensated predic- 
tive encoder utilizing discrete cosine transforms. 
Compressed video signal from the element 1 1 is 
coupled to a formatter 12. The formatter arranges 

55 the compressed video signal and other ancillary 
data according to some signal protocol such as 
MPEG, a standard developed by the International 
Organization for Standardization (Organisation In- 
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ternationale De Normalisation). The standardized 
signal is applied to a transport processor 13, which 
divides the signal into packets of data and adds 
certain other data to provide some noise immunity 
for the transmission purposes. The transport pack- 
ets, which normally occur at a non-uniform rate are 
applied to a rate buffer 14 which provides output 
data at a relatively constant rate conducive to effi- 
cient use of a relatively narrow bandwidth transmis- 
sion channel. The buffered data is coupled to a 
modem 15 which performs the signal transmission. 

A system clock 22 provides clocking signal to 
operate much of the apparatus, at least including 
the transport processor. This clock will operate at a 
fixed frequency such as 27 MHz for example. As 
shown herein, however, it is used to generate tim- 
ing information. The system clock is coupled to the 
clock input of a counter 23 which may be arranged 
to count modulo 2 30 , for example. The count values 
output by the counter are applied to two latches 24 
and 25. The latch 24 is conditioned by the video 
source to latch count values on the occurrence of 
respective frame intervals. These count values are 
denoted presentation time stamps. PTR's, and are 
included in the compressed video signal stream by 
the formatter 12. and are used by the receiver to 
provide lip-synchronization of associated audio and 
video information. The latch 25 is conditioned by 
the transport processor 13 (or the system controller 
21) to latch count values according to a predeter- 
mined schedule. These count values are denoted 
program clock references, PCR's, and are embed- 
ded as auxiliary data within respective auxiliary 
transport packets. 

The system controller 21 is a variable state 
machine programmed to coordinate the various 
processing elements. Note that the controller 21, 
the compressor 11 and the transport processor 13, 
may or may not operate synchronously via a com- 
mon clocking arrangement as long as proper inter- 
communication is provided between processing 
elements. 

Elements 16-26 of FIGURE 1 comprise a re- 
ceiving end of the transmission system wherein the 
modem 16 performs the inverse function of the 
modem 15 and the rate buffer 17 performs, in 
effect, the inverse function of the rate buffer 14. 
Data from the rate buffer 17 is applied to an 
inverse transport processor 18, which provides 
compressed video signal according to the system 
protocol to the decompressor 19. The decompres- 
sor, responsive to the compressed video signal 
generates non-compressed video signal for display 
on the device 20, or for storage etc., in an appro- 
priate device. 

The inverse processor 18 also provides PCR's 
from the auxiliary transport data, and control sig- 
nals to a system clock generator 27. The clock 
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generator responsive to these signals generates a 
system clock signal synchronous with at least the 
transport processor operation. This system clock 
signal is applied to the receiver system controller 
5 26 to control the timing of appropriate processing 
elements. 

Refer to FIGURE 2 which illustrates apparatus 
which may be included in the transmission modem 
1 5 for example. The modem may receive data from 

w a plurality of sources, which data is all to be 
transmitted on a common transmission channel. 
This may be accomplished by time division mul- 
tiplexing of the various signals from the various 
sources. In addition the multiplexing may be lay- 

is ered. For example video programs, P„ may be 
generated in different studios, and coupled to a 
first multiplexer 55. These programs are time di- 
vision multiplexed according to known techniques 
and provided as a source signal Si . 

20 The signal Si , and other source signals S;, 

from other sources are applied to a second layer 
multiplexer 56, wherein the signals S, are time 
division multiplexed according to known techniques 
and predetermined scheduling. Finally, within the 

25 respective programs themselves, there may be a 
further form of multiplexing. This multiplexing may 
take the form of commercials inserted into program 
material or of stored material inserted between 
segments of live production material. In these latter 

30 cases it is presumed that the commercials or 
stored material has been pre-encoded with respec- 
tive PTR's and PCR's. In this instance the PTR's 
and PCR's of the stored material will be unrelated 
to the real time PTR's and PCR's of the live 

35 material. Regarding the PTR's, this will typically not 
create problems because the video signal will in- 
clude parameters instructing the decompressor to 
re-initialize to new signal. Conversely the lack of 
correlation between the stored and real time PCR's 

40 may totally disrupt the rate buffer-inverse transport 
processor elements of a receiver system do to loss 
of synchronization. 

In FIGURE 2 it is assumed that the transport 
processor 53 includes a multiplexing apparatus 

45 similar in operation to the distinct multiplexers 55 
and 56. 

A further problem exists within a multiplexed 
system. In order not to lose data at respective 
multiplexing sites if data concurrently arrives from 

so a plurality of sources, it is necessary to provide a 
degree of signal buffering within the multiplexers. 
These buffers will impose a delay T £ 6t, where 5t 
represents a jitter component. Assume a program 
transits 100 multiplexers (an exaggerated number 

55 to accentuate the problem), and each multiplexing 
adds 1 sec. ± 1 usee, of delay. The end to end 
delay is 100 sec. ± 100 usee, of delay. The 100 
seconds of delay is of little consequence to the 

3 
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decompressor because the compressed video and 
thus the PTR's have undergone the same delay. 
The i 100 usee, of jitter must be accommodated 
or else the decoder buffer may overflow or under- 
flow. 

Figure 3 illustrates a first embodiment of a 
receiver clock regenerator. In this embodiment, the 
transport processor may be located ahead of the 
rate buffer 17, in the signal path, to eliminate 
variable delays which may be incurred in the re- 
ceiver rate buffer. Data from the receiver modem is 
coupled to an inverse transport processor 32, and 
an auxiliary packet detector 31. The inverse trans- 
port processor 32 separates transport header data 
from the respective transport packet payloads. Re- 
sponsive to the transport header data, the proces- 
sor 32 applies video signal payloads (designated 
here as service data 1) to, for example, decom- 
pression apparatus (not shown), and auxiliary data 
(designated as service data 2) to the appropriate 
auxiliary data processing elements (not shown). 
The PCR's residing within the auxiliary data are 
routed and stored in a memory element. 34. 

The auxiliary packet detector 31. which may be 
a matched filter arranged to recognize the 
codewords designating an auxiliary transport pack- 
et containing a PCR, produces a control pulse on 
the occurrence of transport packets containing 
such data. The control pulse is utilized to store 
within a latch 35, the count value currently exhib- 
ited by the local counter 36. The local counter 36 is 
arranged to count pulses provided by a e.g. ; volt- 
age controlled oscillator 37. The counter 36 is 
arranged to count modulo the same number as its 
counterpart counter in the encoder (counter 23). 

The voltage controlled oscillator 37 is con- 
trolled by a low pass filtered error signal provided 
by a clock controller 39. The error signal is gen- 
erated in the following fashion. Let the PCR arriving 
at time n be designated PCR n and the count value 
concurrently latched in latch 35 be designated L n . 
The clock controller reads the successive values of 
PCR's and L's and forms an error signal E propor- 
tional to the differences 

E^IPCRn-PCRn-, l-IU-U-il 

The error signal E, is utilized to condition the 
voltage controlled oscillator 37 to a frequency ten- 
ding to equalize the differences. The error signal 
produced by the clock controller 39 may be in the 
form of a pulse width modulated signal, which may 
be rendered to an analog error signal by imple- 
menting the low pass filter 38 in analog compo- 
nents. 

The constraints on this system are that the 
counters at the two ends of the system count the 
same frequency or even multiples thereof. This 
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requires that the nominal frequency of the voltage 
controlled oscillator be fairly close to the frequency 
of the frequency of the system clock of the en- 
coder. 

5 The foregoing approach provides rather rapid 

synchronization but may introduce a long term 
error. Long term error LTE is proportional to the 
difference 

io LTE * |L n - Lq| - |PCR n - PCRo| 

where PCRo and Lo are for example the first occur- 
ring PCR and the corresponding latched value of 
the receiver counter. Nominally the error signals E 

is and LTE will vary in discrete steps. As such, once 
the system is "synchronized" the error signal will 
dither one unit about the null point. The preferred 
method of synchronization is to initiate control of 
the voltage controlled oscillator using the error sig- 

20 nal E until a one unit dither occurs in the error 
signal E, and then to switch to the use of the long 
term error signal LTE to control the voltage con- 
trolled oscillator. 

In order to accommodate the delays T ± 6t, 

25 incurred in the multiplexing process, the transport 
processor at the encoder creates an auxiliary field 
within an auxiliary transport packet which contains 
information relating to variable delays. Provision is 
made for modifying this variable delay information 

30 at respective multiplexing locations. Refer to FIG- 
URES 6 and 7. FIGURE 6 illustrates pictorially a 
transport packet of the type used in the High 
Definition Television System developed by the Ad- 
vanced Television Research Consortium. This 

35 transport packet includes a prefix which contains, 
among other things, a general identifier to indicate 
to which service the payload contained within the 
packet is related. The field CC is a continuity check 
value included for error check purposes. The HD 

40 field is a service specific header which specifically 
defines the payload. For example, if the particular 
service is designated to provide television pro- 
gramming, respective payloads of the transport 
packets of that service type may include audio 

45 data, video data, or related auxiliary data. The HD 
field thus indicates the particular payload type for 
the particular packet. 

FIGURE 7 illustrates a transport packet which 
includes auxiliary data. The payload of an auxiliary 

so transport packet may include one or more auxiliary 
groups, depending on the amount of data included 
in respective groups and the current system re- 
quirements. In the transport packet illustrated in 
FIGURE 7 there are two auxiliary groups containing 

55 data related to the program clock reference, AUX1 
and AUX2. The auxiliary group AUX1 includes data 
related to variable delays and the group AUX2 
includes the PCR per se\ The respective groups 

4 
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include an auxiliary group prefix and an auxiliary 
data block. The prefix includes the fields MF. CFF, 
AFID. and AFS. The field MF is a 1-bit field which 
indicates whether the data in the packet is modifi- 
able (1 if modifiable 0 if not). CFF is a 1-bit field 
which indicates whether auxiliary data is defined for 
this group. AFID is a 6-bit field which identifies the 
type of auxiliary data contained in the group, e.g., 
time code, scramble key, copyright, etc. AFS is an 
8-bit field defining the number of bytes of auxiliary 
data contained in the group.' 

The AUX1 group is shown as being modifiable 
and the AUX2 group is shown as not being modifi- 
able. AUxr data is shown to be PCR data i.e. the 
prograrr ci«>:k reference. The AUX1 data is in- 
dicated a:. DPCR data which is an acronym herein 
for diii' »• ■< tiai program clock reference. The PCR 
data r: < ,»i-«uf«J under control of a scheduler which 
ccntr -i> transport processor in the encoder. 

DPCR .t.i!.i - iptared as will be described with 
rRSw. fi. , i f n ,URF 4. 

Tm. f i* itJHf 4 apparatus is exemplary appara- 
tus rf .. i « »?i ^ of one of the multiplexer circuits 
sh. • f idUME 2 Associated with respective 
inpi;i ! • • * a tuffer store 67 which may be a 
FIFO C .i:.. i * s'ored therein when program data 
an*. • mul:iplexer is currently accessing a 

6ttu ' t us Thereafter, according to the 

sch. ■' tr*.- multiplexer, the program data is 

read*' r« t ii*tof store 67. 

u- ■ . » ■ t v- transport packets of the program 
dota >. au «iiiary groups containing PCR and 
DPCM \»\. N..i t ; that the value of the PCR data is 
cM, ,r-.r^- f, tat ve to the timing of the transport 
p6' • * t.Aio.rvj tie auxiliary timing information. 
Thu f*-..n lata when output by the multiplexer, 
may t« " t»f:rf by virtue of any delays incurred 
di.» t T'tt+itiun of signals in the multiplexing 
pr> ... -viay time T t st taken to transit the 
bun- •! i-. csod to modify the DPCR data to 
sut \.*-;< • civrect such errors. An auxiliary 
pu-.;n' * v i - 61. arranged to detect the occur- 
red i ' r-.u--;-ft packets containing DPCR data, 
is c d r tr*j program data input bus. This 
dctt- : t . <is to reset and enable a counter 62 

to count (aji'.j-s of a local clock 60. The local clock 
60 rra> t.« a crystal oscillator having a frequency 
which t* vory close to the encoder system clock 
frequency or it may be frequency locked to the 
encoder clock as per the operation of the FIGURE 
3 or 5 apparatus. A further auxiliary packet detector 
63 is coupled to the output bus of the buffer store 
67, and is arranged to store current count value 
output the counter 62 in the latch 68 when the 
auxiliary packet containing the DPCR data emerges 
from the buffer. At this time the output of the 
counter will exhibit a count value, in units of cycles 
of the clock frequency, of the transit time through 



the buffer of the particular packet. Note, if a plural- 
ity of auxiliary packets are likely to occur in close 
proximity, such that more than one may be concur- 
rently transiting the buffer 67, the auxiliary packet 

5 detectors must be arranged to detect and respond 
to the first occurring packet. 

The auxiliary packet detector 61 also provides 
a control signal which is applied to condition a 
latch 64 to store the DPCR value contained with'in 

70 the auxiliary packet. This value is applied to one 
input port of an adder 65. The local count value 
stored in the latch 68 is applied to the second input 
port of the adder 65. The adder 65 sums the DPCR 
data from the current auxiliary packet with the local 

75 count value to provide an updated DPCR value 
DPCR'. The program data from the buffer 67 and 
the output of the adder 65 are coupled to respec- 
tive input ports of a 2-to-1 multiplexer 66. The 
multiplexer 66 is conditioned by the auxiliary pack- 

20 et detector 63 to normally pass the program data. 
However when the DPCR data contained in the 
program data emerges from the buffer, the mul- 
tiplexer 66 is conditioned to pass the updated 
DPCR' data from the adder, and then switch back 

25 to passing data from the buffer 67. 

When the multiplexer 66 is conditioned to pass 
data from the adder, the output signal from the 
adder corresponds to the sum of the DPCR data 
contained in the auxiliary packet plus the count 

30 value in the counter 62 when the DPCR data 
emerges from the buffer. The data substituted for 
the DPCR data by the multiplexer 66 is thus the 
prior DPCR data corrected for its transit time in the 
buffer 67. Note, it is recommended that the auxil- 

35 iary packet detector be programmed to only 
change program data in accordance with the ap- 
propriate modifier flags, MF, of the auxiliary 
groups. 

Referring back to FIGURE 2, the transport pro- 

40 cessor 53 will establish the DPCR auxiliary groups 
and normally insert a zero value for the DPCR data 
corresponding to new programs. Recall however, 
that stored data from the digital storage media 51 
may be inserted between segments of live data, 

45 and that the stored data may be pre-encoded with 
PCR and DPCR codes. When the transport proces- 
sor 53 is to insert stored data between segments of 
live data, it accesses the PCR code of the stored 
data and subtracts this PCR value from the count 

so value currently exhibited by the counter 23 and/ or 
latch 25. The transport processor then adds this 
difference to the DPCR value in the auxiliary pack- 
ets of the stored data. The new DPCR values in the 
stored data inserted between live data now con- 

55 tains a reference to current time. This process is 
illustrated in the flow chart of FIGURE 8. which is 
self explanatory. 
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The use of the DPCR data in a receiver is 
illustrated in FIGURE 5. In FIGURE 5 elements 
designated with the same numerals as elements in 
FIGURE 3 are similar and perform similar func- 
tions, except that the function of element 32 has 
been modified. The modification involves including 
adder 45 arranged to sum the corresponding PCR 
and DPCR values arriving in associated auxiliary 
groups. The sums provided by the adder cor- 
respond to the original PCR value augmented by 
any transit delays incurred in multiplexing for ex- 
ample. The sums are placed in memory 46 where 
they are available to the clock controller 39 as 
corrected PCR' values for system clock synchro- 
nization. 

Claims 

1. Video signal compression apparatus character- 
ized by: 

a source (10) of video signal; 

a source (22) of a clock signal; 

a counter (23) for counting said clock sig- 
nal modulo N. where N is an integer; 

means (24) for selecting ones of count 
values provided by said counter as Presenta- 
tion Time references, which Presentation Time 
references are associated with predetermined 
segments of said video signal; 

compression means (11,12) for compress- 
ing said video signal and hierarchically format- 
ting compressed video data with said Pre- 
sentation Time references included; 

means (13,25) for periodically selecting 
further count values provided by said counter 
as Program Clock References; 

a transport processor (13) coupled to re- 
ceive formatted compressed video data includ- 
ing said Presentation Time references from 
said compression means, for segmenting said 
compressed video data into transport packets 
including transport headers and wherein said 
Program Clock References are included in 
ones of said transport packets; and 

means (14,15) for conditioning said trans- 
port packets for transmission. 

2. The apparatus set forth in Claim 1, character- 
ized in that said transport processor includes 
means for determining instances when said 
Program Clock References are to be selected 
by said means for periodically selecting further 
count values. 

3. The apparatus set forth in Claim 1, character- 
ized in that said transport processor forms 
transport packets of compressed video data 
and auxiliary transport packets including said 



Program Clock References, and includes 
means for interspersing said auxiliary transport 
packets with transport packets of compressed 
video data. 

5 

4. Apparatus for synchronizing at least a portion 
of a compressed video signal receiving system 
which processes a compressed video signal 
occurring in transport packets of compressed 
w video signal interspersed with transport pack- 

ets which include count values periodically ob- 
tained from a counter arranged to count 
modulo M, pulses of an encoding system clock 
where M is an integer, said apparatus char- 
ts acterized by: 

a source (17) of transport packets includ- 
ing compressed video transport packets and 
transport packets which include said count val- 
ues; 

20 a controlled oscillator (37). responsive to a 

control signal, for providing a receiver system 
clock; 

a receiver counter (36) arranged to count 
pulses of said receiver system clock modulo 
25 M; 

means (31,55). responsive to the occur- 
rence of transport packets which include said 
count values, for storing count values output 
by said receiver counter; and 

30 means (38.39) responsive to the differ- 

ences of count values in successively occur- 
ring transport packets which include said count 
values, and differences in corresponding suc- 
cessively stored count values output by said 

35 receiver counter for generating a control signal, 

E, for controlling said controlled oscillator. 



The apparatus set forth in claim 4, character- 
ized in that said means for generating said 
control signal, E, includes means for calculat- 
ing said control signal, E, proportional to: 



40 



45 



so 



E =f( |PCR n - PCR„-,| - |lRCV n - RCV„-,|) 

where PCR n and PCR n -i are successive count 
values occurring in transport packets and 
RCV n and RCV n -! are corresponding stored 
count values output by said receiver clock. 



6. The apparatus set forth in claim 5, character- 
ized in that said means for generating said 
control signal, E, further includes: 

means for storing count values PCRo and 
RCV 0 which correspond to a count value oc- 
as curring in a transport packet occurring at sys- 
tem start up and a corresponding receiver 
count value respectively; 

means for calculating a control signal, E\ 
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proportional to: 

E* =f( |PCR n - PCR 0 | - ]RCV n • RCVo|) 

means for selectively providing said sig- 
nals E or E' as control signals for controlling 
said controlled oscillator. 
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